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Public/Catholic Differences in the High School and Beyond Data: A Multi- 
group Structural Equation Modelling Approach to Testing Mean Differences 

ABSTRACT 

Previous research with the large, nationally representative High School 
and Beyond (HSB) data has compared senior year achievement test scores for 
public and Catholic high chool students after controlling for background 
variables and sophomore year test scores. These analyses, however, were 
based on traditional applications of multiple regression with its 
implausible assumptions that var iables are measured without error and that 
residuals are uncorrelated. The present study demonstrates tests for mean 
differences on latent constructs using the LISREL approach to multi -group 
structural equation modelling for this substantively important issue. 
Public/Catholic differences, even after controlling for background and 
sophc-Rore outcomes, favored Catholic high school students on senior year 
outcomes (achievement, educational aspirations, and academic course 
selection) and subsequent college attendance. These public /Catholic 
differences were similar for students differing in race, SES, and initial 
ability. Public/Catholic differences in achievement, educational aspirations 
and college attendance were, however, apparently mediated by the academic 
orientation of course selection* The flexibility And AdvantaQes but also 
the limitations — of this multi-group SEH approach are discussed. 
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Latent Itoan Differences 1 
Public /Catholic Differences in the High School and Beyond Data: A llulti- 
group Structural Equation Modelling Approach to Testing Mean Differences 

The present investigation has two aajor purposes, a substantive purpose 
and a Methodological purpose. The substantive purpose is to compare outcomes 
for students who have attended public and Catholic high schools based on the 
High School and Beyond (HSB) data. The methodological purpose is to 
demonstrate tests for mean differences in latent constructs using the LISREL 
approach to multi -group structural equation modelling (SEM). Because this 
methodological demonstration addresses complicated, substantive issues 
derived from previous research, the present study also provides an opportunity 
to examine the flexibility, strengths and limitations of this approach. 
I!l§ Sybstanti ye Issye ~ Publ ic/CathoLU Dif f ergnces in the HSB Data 
The large, nationally representative High School and Beyond (HSB) data 
base has stimulated considerable interest in academic achievement effects 
attributed to attending public and Catholic high schools in the U.S. Because 
this research is reviewed elsewhere (e.g., Alexander & Pallas, 1985; Hoffer, 
Breeley & Coleman, 1983; Jencks, 1985; Marsh, 1988; Willms, 1985; Holfle, 
1987), it is only summarized briefly. Using cross-sectional analyses based 
on just the first wave of HSB data (the 1980 cohorts of sorhomores and 
seniors), Coleman, Hoffer and Kilgore (1981, 1982) concluded that Catholic 
school students learned more than public school students during their last 
two years of high school. This initiated heated debate (e.g., Boldberger & 
Cain, 1982), a flurry of reanalyses (Alexander & Pallas, 1983; Cain & 
Goldberger, 1983; Morgan, 1983) and rejoinders (e.g., Coleman & Hoffer, 
1983). Nhersas basic issues were unresolved, Jencks (1985) concluded that; 
*A11 parties to this debate agreed, however, that the 1980 data were not 
ideal for estimating the effect of Catholic schooling, since there was no 
completely satisfactory way of knowing what seniors in 1980 were like when 
they were sophomores in 1978, or what sophomores in 1980 would be like when 
they became seniors in 1982" (p. 128). 

The availability of the second wave of (1982) data provided a much 
stronger basis for subsequent analyses. Jencks noted that (1985, p. 128): 
"One major purpose of the High School and Beyond (HSB) study was to assess 
the impact of different kinds of schooling on how much students learned in 
the last two years of schooling." Jencks (1983) also provided a summary and 
critique of the three initial major analyses of public/Catholic differences 
based on sophomore and senior responses by the 1980 sophoMre cohort 
(AleNander ti Pallts, 1989| Hoffer, Greeley 1^ ColeMn, t98S| Nillms, 1983). 

ERIC 4 



I 



Latent Mean Differences 2 

All three studies found that senior Catholic high school students 
outperformed public high school students on standardized achievement tests, 
even after controlling for family background and sophomore achievement. There 
were still, however, important unresolved differences in the three studies. 

1. The three studies differed on the variables that were controlled in 
inferring sophomore-to-senior growth. All the studies corrected 1982 
achievement test scores for at least some background variables and the 
matching 1980 achievement test score. Willms (1985) controlled 1982 test 
scores for other tests scores in addition to the matching test score. This 
approach is generally better in that a more broadly based set of control 
variables is more likely to control for pre-existing differences than is a 
single variable within the set of control variables. This approach also 
allows researchers to consider other senior year outcomes and post -secondary 
outcomes (available in the third wave of data) that do not have a matching 
1980 outcome variable. Both Jencks (1985) and Hoffer et (1985) 
acknowledged the appropriateness of this approach but indicated that it mad*: 
little difference in the results for achievement test scores. 

2. Willms (1985) estimated a single regression equation from the total 
group covariance matrix, whereas Alexander and Pallas (1985) and Hoffer et 
al. (1985) estimated separate regression equations for the public and 
Catholic high school samples. Willms inferred publ ic/Cathol ic differences 
from a dummy (dichotomous) variable that represented school type. The other 
two studies resulted in slightly different estimates of the effect depending 
on whether regression equations based on the public or Catholic school 
sample were used (see Jencks, 1985). 

3. Alexander and Pallas (1985) corrected both the 1980 and 1982 test 
scores for internal consistency estimates of reliability (Heyns and Hilton, 
1982). This approach assumes that "error" (i.e., random error and 
uniqueness) estimated from one administration of a test is uncorrelated with 
"error" estimated for a second administration of the test. When the same 
test is administered on two occasions, however, correlated uniquenesses 
(sometimes referred to as correlated errors) are likely. If, for example, 
the test-retest correlation exceeds the internal consistency estimates of 
reliability, then the "corrected" test*retest correlation would be greater 
than 1.0. Since there probably are correlated uniquenesses in the test 
scores, the Alexander and Pallas approach may seriously overestimate the 
correlation between 1980 and 1982 test scores (Hoffer, et al. 1985). On the 
other hand, when there are moderate amounts of meaauremcnt mrrar^ Cohen and 
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Latent Mean Differences 3 

Cohen (1983) and Pedhazur (1982) and oth^?rs have noted that the traditional 
regression equations can lead to grossly inaccurate results (also see 
Ale:<ander ?e Pallas, 1985; Jencl^s, 199?). J»^ncVs tojV -ioldCt? in the 
observation that both approaches resulted ir. ^imil.^r patterns of schwjijl-type 
effects though this observation was based jr.ly on achievement test siijres. 
Tt should be noted, however, that two wronjs do not n^?^es6aril / mafe ji right 
even when they lead to similar conclusions. Furthermore, Hieffer et al,, 
noted that these two approaches ii f lead to very Jiff-^r er^t ^oncl usi-ji.s about 
the presence — and ever, the Jirectiir. — :f inter vrt i lin effects '3^>e point 
4). In summar/, this probleir; uias rot ^atisf actoril> a'l'Jr^iiSr?.! in .*ny jf the 
studies or in JencVs's critique of them. 

4) Willms (1985) tested *or interactions between the publ ic/Ca*Kolic 
grouping variable and bacl-grjund characteristics b/ including; cross-product 
terms in his single regression equation. Because these interaction ♦lerms added 
little to variance explained and were nearly al*Mays nonsignificant, his 
results suggested that public/Catholic differences were si-^riilar for different 
types of students. In the two-equation approach, tests of inter actioris were 
made by comparing the regression coefficients in each equation. Hoffer", et al 
(1985) reported that SES, dujnmy variables for being Black and being Hispanic, 
and initial achievement had more iiijpact on achievejaent in public schools than 
in Catholic schools, though few of these interaction effects were 
statistically significant . They interpretted this to .nean that Catholic high 
schools more closely approximated a common-school ideal ^ince initial 
disadvantages had less negative effects in Catholic high schools. In contrast, 
Alexander and Pallas (1985) found that after correcting for unreliability (see 
point 3) initially disadvantaged students were slightly better off iri public 
schools, though few of these differences were statistically significant. 
Hoffer et al countered that the Ale:<ander and Pallas results were an 
artifact of their inappropriate correction for unreliability. In hif, review, 
Jencks (1985) did not comment on the appropriateness of the Alexaiider and 
Pallas tests of interaction effects. Jencks concluded that whereas there was 
little convincing evidence for the e::istence of interaction effects, these 
tests were not sufficiently powerful to conclude that they did not exist, 
Kenny and Judd (1984) and others have commented more generally on the 
problems of trying to infer interaction effects from fallible measures — 
even when a latent construct approach is used. 

3. Throughout the HSB studies of public/Catholic differences, high 
school track has played a controversial role. Reieerchers have coneittently 
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found that Catholic high school students are more likely to be in academic 
tracks during their sophomore year. In early analyses conducted before the 
second wave of data "as available, Coleman et al. (1982) argued that this 
represented a school-policy difference that produced achievement differences 
Nhereas others suggested the effect of track should be controlled as a proxy 
of initial ability differences. When the second wave of HSB became available 
Hoffer, et al. (1985) found that school -average measures of the proportion 
of students in acaJemic tracks during their sophomore year accounted for 
some — but far from all — of the public/Catholic differences in senior 
achievement test scores. They concluded that their results provided at least 
some support for their earlier claims about track effects. In contrast, 
using their correction for unreliability Alexander and Pallas (1985) found 
that controlling for track had almost no effect on public/Catholic 
differences in senior achievement test scores beyond what could be explained 
by background variables and sophomore test scores. They concluded that there 
was no support for Coleman et al.'s earlier claims. Willms (1985) and Jencks 
(1985) did not emphasize the effect of school track. None of these studies 
considered the effects of track placement in the senior year, nor whether 
public /Catholic differences in this variable were stable over the last two 
years of high school. 

Marsh (1988) further analyzed public/Catholic differences on the basis 
of three waves of HSB data instead of jUst the two waves previously 
available. He, as did Willms (198S), used a dummy variable in a single 
regression equation to assess public/Catholic differences after testing for 
many possible interaction effects. Two particularly important variables that 
he considered were not available previously: (a) the number of academically 
oriented courses completed by students as determined by an evaluation of 
their actual high school transcripts by HSB staff and (b) college attendance 
in the first two years after high school. The public/Catholic difference in 
academic track actually grew larger during the last two years of high 
school. The larges^ Catholic advantages — after controlling for background 
and sophomore outcomes — were for the new courcework selection variables. 
There was also a Catholic high school advantage in college attendance after 
controlling for background and sophomore outcomes, though this effect was 
largely mediated through senior outcome variables. Furthermore, controlling 
for track and the academic course selection in the senior year in addition 
to background and sophomore outcome variables, eliminated all statistically 
significant public/Catholic differences in the remaining senior and post- 
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secondary cxitcomes. Harsh interpretted these findings to suggest that the 
observed public/Catholic differences were largely mediated by differences in 
the academic orientation of course selection, findings that supported the 
Hoffer, et. al. (1985) proposal. Marsh also found that publ ic/Cathol ic 
differences were very similar for single-sex and coed Catholic schools and 
that publ ic/Cathol ic differences were very small — mostly nonsignificant — 
for affective variables such as locus of control, esteem, academic self- 
coiicept. Although Harsh provided new evidence about publ ic/Cathol ic 
differences based on the HSB data, his study suffered limitations of earlier 
research that are inherent in the traditional use of multiple regression. 

Individual test scores in specific subjects have been the basis of most 
of public /Catholic comparisons with the HSB data. Because there is only a 
single total score for each test, there is no fully adequate way to estimate 
reliability. Because they had access to item level data, Heyns and Hilton 
(1982) provided KR-20 reliability estimates for the tests administered in 
the first year of the study. Nhereas this is useful information, correcting 
correlations for these estimates as did Alexander and Pallas (1983), is 
likely to provide an inflated estimate of the test-retest correlation for 
matching sophomore and senior tests. Heyns and Hilton (1982) also factor 
analyzed the set of sophomore tests. They concluded that there was "little 
empirical basis for hypothesizing more than two factors in the battery" (p. 
93). The two factors were readily identifiable as a verbal and a math 
factor. Because there are multiple indicators of each of these latent 
constructs, it is possible to obtain estimates of the error /uniqueness 
associated with each test without item-level data and to test for the 
existence of correlated uniquenesses across the two testing occasions. 
Implicit in this approach is the not inconsequential assumption that the 
small amount of uniqueness (or specific variance) associated with some of 
the tests (see Heyns & Hilton, 1982) is not of interest. 

All four studies examined here as well as others known to the authors 
Mere based on traditional applications of multiple regression using ordinary 
least squares estimates. Although widely used, this approach imposes 
apparently unrealistic assumptions such as (a) variables are measured 
without error and (b) residuals are uncorrelated. Particularly when there 
are multiple indicators of most of the underlying constructs, SEH provides a 
more powerful approach that does not impose these unrealistic assumptions. The 
purpose of the present investigation is to further analyze public/Catholic 
differences using the multi-group LISREL (Joreskog & Sorbom, 1981) approach to 
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Latent Mean Differences 6 

testing differences in Utent construct means as described by Sorbo . r.'^'^r., 
also se^ Hanna and Lei, 198S; Joreskog and Sorbom, 1981; and Sorbor^ 

Methods 

§3!5IL1§ SQd Var i able§ 

Data for the present investigation are based on responses by the 
sophOAore cohort of the MSB study. A detailed description of this data base is 
available in the user's eanual produced by the National Center for Educational 
Statistics (NCES, 1986). The data file includes variables collected in 1980 
Nhen respondents were sophomores, in 1982 when respondents were seniors, and 
in 1984 two years after the norMl time of high school graduation. The 
sophomore cohort initially involved a two-stage probability sample of 1,015 
high schools and approximately 36 sophomores within each of these schools. The 
second follow-up consisted of a probability sample of 14,823 of the original 
sample. For present purposes, students were selected from the second follow-up 
i#io: €a) attended a public or Catholic high school (private school students 
were excluded) and €b) attended the same school in 1980 and 1982 (students who 
had the same school identification number both years, had not dropped out, had 
not transfered to another school, and had not already graduated). This left a 
total of 10,507 students from 853 public schools and 80 Catholic schools. 

Responses in the present analysis were weighted so as to hold constant 
the total sample size but to take into account the disproportionate sampling 
of specified subgroups — particularly the over-sampling of Catholic high 
school students — in the MSB design (NCES, 1986j Table 3.5-1). ^e original 
unweighted and subsequently weighted sample sizes were: 8175 and 9744 
(public school); 2332 and 763 (Catholic school). Because of the cluster 
sampling in the MSB study, standard errors based on the assumption of simple 
random sampling substantially underestimate the sampling variability in 
summary statistics and distort tests of statistical significance. In order 
to coMpensmte for this bias, the weight for each respondent was divided by 
the estimated design effect of 2.40 (NCES, 1986, Table 3.6-5), reducing the 
nominal sample size from 10,507 to 10,507/2.4*4,378. (This reduction in 
nominal sample size has no effect at all on cell means and parameter 
estimatesi it only affects the df used in tests of statistical 
significance.) Moment matrices were constructed for each group separately 
using pair-wise deletion for missing data. The weighted number of cases for 
each variable varied from 3656 to the maximum of 4p378, and the minieum 
p^irwise number of cases was 3232. For purposes of testing statistical 
significance! sample sizes of 300 and 3p700 nere used for the Catholic and 
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public schools respectively. 

The 27 variables selected for consideration (see Appendix 1 and Table 
1) were classified as background variables, or as sophomore, senior, and 
post-secondary outcome variables. Background variables were two indicators of 
social economic status (SES) and two variables that reflected race/ethnicity. 
A total of 23 outcone variables were selected to represent potentially 
important influences of school -type; 20 (10 pairs) were matching measures 
collected in both sophomore and senior years, 1 was a senior outcome that had 
no matching sophomore outcome, and 2 were multiple indicators of post- 
secondary education. These outcome measures included standardized achievement 
tests, educational aspirations, academic track, number of academic credits 
measured in the sophomore and/or senior years, and college attendance during 
the two years after the normal graduation from high school. 

Insert Table 1 About Here 

Itlg eeelicatieQ of ttn LISREL ABBCgacb to SETI of Groug Dif f gcgnces. 

Weaknesses of the traditional use of multiple regression for estimating 

path coef f icients£, particularly for longitudinal data, are well known (e.g., 

Joreskog & Sorbom, 1981; Kenny, 1979; Long, 1983a, 1983b; McDonald, 1985; 

Pedhazur, 1982; Rogossa, 1979) and so are not reviewed here in detail. 

Perhaps the most serious weakness in the traditional multiple regression 

approach is the assumption that the single score used to infer each 

construct is measured without error. Particularly when multiple indicators 

of the inferred constructs are available, SEM using statistical packages 

such as LISREL provide important advantages. 

Itig ECiOCi tteiSyCStgQt and Structyrgl Hgdels^ 

Although parameters for the entire model are estimated simultaneously, 

the model can be logically separated into measurement and structural models. 

The measurement model contains estimates of the relations between each 

latent construct and its multiple indicators (i.e., factor loadings) and 

error /uniquenesses associated with each measured variable. The structural 

model contains estimates of causal relations between the latent constructs 

(i.e., path coefficients) that are corrected for measurer«ient error. 

lbs fiSiSyCSaSQi^ 99^X2. ^ priori measurement model is summarized in 

Table 1. The latent constructs «et> to <et> ) associated with each 

1 13 

measured variable (yl to y27) are presented in Table 1. Most of the latent 
constructs are associated with two or more measured variables and most of 
the measured variables are associated with only one latent construct. The 
factor loading of the first indicator of each construct was fixed to be 1 in 
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Latent Mean Differences 8 

order to set the scale of the latent construct. 

Hany of the measured variables associated with the sophomore and senior 
constructs were actually the same variable administered on two different 
occasions. It was posited a priori that each of the uniquenesses for 
measured variables from the sophomore year (the multiple indicators of math 
and verbal achievement, and of educational aspiration^* — y5-/13 in Table 1) 
was correlated with the uniqueness for the matching senior indicator (yl5- 
y23). In preliminary analyses, 8 of these 9 correlated uniquenesses — all 
but the one relating yS and yl5 — were statistically significant and these 
8 correlated uniquenesses were retained in subsequent analyses. The scales 
for each of the latent constructs were set by fixing the factor loading for 
the first measured variable to be 1.0. For all single-indicator latent 
constructs, the uniqueness of the single indicator was fixed to be zprc. 

The latent constructs are grouped into cluster?^ '-epresenting background 
constructs, sophomore constructs, senior constructs, an J the single post- 
secondary construct. For the first three clusters * at Dntain multiple 
constructs, the latent constructs within the same cluster were posited to be 
correlated. 

§&Ci£&yC3l SOdsL: I" initial, a priori model, late..t constructs at 
each level were posited to effect all subsequent constructs: (a) background 
constructs affected sophomore, senior, and post-secondary outcomes, (b) 
sophomore outcomes affected senior and post-secondary constructs, and (c) 
senior constructs affected the post -secondary construct. In subsequent 
models variations of this initial structural model were considered in order 
to tmst substantive .ssues. 

Insert Figure 1 About Here 

EflfiiOCiSl lOyiCiiQ^Sj. Tests of factorial invariance require that any 
one, any set, or all parameter estimates in one group are the same across 
multiple groups — in this case the public and Catholic high school samples. 
The advantagms of CPA approach to factorial invariance over the comparison 
of solutions based on mxploratory factor analyses are well-known (Alwin & 
Jackson, 1981} Joreskog Ic Sorbom, 198i| Harsh, 1987| Harsh Hocevar, 1985) 
and so well not be considered herm in detail. Nhereas tests of the 
invariance of any or all parameters can bm tmsted, the minimum condition of 
factorial invariance is frequently taken to bm thm invariance of the factor 
loadings (m.g.. Harsh & Hocmvar, 198S). Thus, thm fit of onm modml that 
rmquirmm all factor loadings to bm thm same is comparmd with thm fit of 
anothmr modml that dots not rmquirm this invariancm (smm marlimr discussion 
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of goodness of fit). Byrne and Shavelson (in press) and Byrne, Shavelson and 
nuthen (1987) have noted, however , that further tests are meaningful even 
when strict tests of factorial invariance are not supported. In these 
applications, however, differences in the factor loadings for the two groups 
were very small. 

Ibg 3Q3ly§i§ of §try£tured means^ Following Sorbom (1982; Joreskog and 
Sorbom, 1981) the analysis of mean structures was carried out on an 
fiUgmented (i.e., a constant variable 1 was added) moment matrix. The input 
to LISREL comprised: (a) two 28x28 correlation mat^^ices including one row of 
zeros corresponding to the constant variable in addition to the 27 variables 
listed in Table 1; (b) two vectors of 28 means in which the constant term 
was assigned a mean of 1; and (c) two vectors of standard deviations in 
which the constant term was assigned a value of zero. LISREL constructed 
separate moment matrices for the public and Catholic school samples. 

The mathematical translation of Sorbom' s approach to the present 
investigation and the input to the LISREL V program used to estimate the 
parameters is presented in the Appendix 2. Briefly: (a) the original 27 
measured variables are specified to be ys and the associated 13 latent 
constructs were specified to be <et)s; (b) the "constant** variable was given 
a fixed-X specification; (c) the factor loading <LX> matrix was augmented to 
accomodate the constant variable by adding one column (the 14th) that was 
used to represent measurement intercepts <mu>s; (d) the (PS> matrix was 
augmented to accomodate the constant variables by adding an extra row (the 
14th) of zeros; (e) mean differences in latent constructs were estimated in 
<GA> by fixing all the parameter estimates <al>s to be zero in one group and 
freely estimating the these parameters in the second group. Since the 
measurement intercepts and latent means cannot be Identified simultaneously, 
absolute mean estimates are not possible. Latent (tf^an differences between 
groups are estimated by fixing the latent means in one group to be zero, 
freely estimating the latent means in the second group, and testing whether 
the latent mean^esti mates in the second group differ significantly from zero- 
Comparing the X for two nested models that differ only due constraining 
latent mean differences to be zero (i.e., fixing parameter estimates in <GA> 
to be zero in both ^'~oups) provides a multivariate omnibus test of latent 
mean differences. 

BlAflCSiSS ia CSeCSSfQt mgdel§ gf latent ssiO diiiiCSDSfiSj. As 

described in Appendix 2, we have endeavored to represent models of latent 
mean differences so as to highlight important features. To illustrate this 
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convention, consider model M2 (figure 1). Ovals represent clusters of latent 

constructs that do not causally influence each other: (1) the 3 background 

constructs; (2) the 4 sophomore constructs; (3) the 5 senior constructs; and 

(4) the 1 post-secondary construct. For clarity we have totally omitted the 

measurement cl^ oonents of these constructs. The only parameters on the graph 

are those free to vary between the two groups (i.e., public and Catholic). 

Single-headed arrows show putative causal links, whereas double-headed arrows 

represent covariances. All constructs are assumed to causally influence 

those to the right, although only lag-1 arrows are shown. The triangle 

represents the "constant" variable used by LISREL to estimate latent mean 

differences. Thus, in model H2 (figure 1), <al> represents the mean 

difference in post-secondary attendance (see Table 1) after adjusting for 

background, sophomore, and all senior consstructs. In model M8, only the 

background and sophomore constructs are adjusted for, whereas in model M9 

<al> represents the sector difference on post-secondary attendance 
13 

adjusting for background, sophomore and just two of the senior outcomes. 
(The substantive basis of these modeis is decribed in detail as part of the 
presentation of the results.) 
iQ9^Q§§§ 9i fit i 

An important, unresolved issue in SEM is the assessment of goodness of 

fit. On the basis of theory and previous research, the researcher typically 

posits a set of alternative models designed to explain relations among the 

measured variables. To the extent that the hypothesized model is able to 

fit the observed data, there is support for the model. The problem of 

goodness of fit is how to decide whether the predicted and observed results 

2 

are sufficiently alike to warrant support for a model. Whereas X values can 

be used to test whether these differences are statistically significant, 

there is a growing recognition of the inappropriateness of the classical 

hypothesis testing approach. Because restricted models are only designed to 

approximate reality, all such models are a priori false and will be shown to 

be false if tested with a sufficiently large sample size (Cudeck Si Browne, 

1983| Harsh, Bella & HcDonald, 1988| Marsh, HcDonald Sc Balla, 1988} 

McDonald, 1985). This problem is particularly obvious in studies like the 

present one in which sample sizes are so large that even trivial differences 

2 

will result in large, statistically significant X s. Model selection must be 
based on a subjective combination of substantive issues, inspection of 
parametar values, goodness of fit, model parsimony, and a comparison of the 
parf orMnces of competing models. A variety of fit indicas hava bean darivad 
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2 

to aid in this process such as the X /df ratio, the Tucker-Lewis Index (TLI; 

Tucker & LewiSp 1957), the Bentler*Bonett Index (BBI; Bentler & Bonett, 

1980) that are considered here. In simulation studies of these and other 

indices Marsh, Balla and McDonald (1988) and Marsh, McDonald, and Balla 

2 

(19B8) found that the X /df and the TLI imposed apparently appropriate 
penalty functions for the inclusion of additional variables that controlled 
for capitalizing on chance, whereas the TLI was also relatively independent 
of sample size. 

BiiyliS §Qd Discussion 

IS1&3 of 6Ii§CQiiL^§ dSdglSt 

The initial model considered here (Ml in Table 2) was based on the 

assumption that all parameters except the latent construct means were 

invariant across the two groups. Due primarily to the large sample size, 
2 

the X for this model (1450 with df-632) is statistically significant, but 

the fit indices (e.g., TLI=.987) suggest that the fit is reasonable. 

Inspection of the standard deviations for the measured variables (Table 1) 

indicates, however^ that group variances for the first four variables — 

those associated with SES and race — differ substantially for public and 

Catholic high school students. Not surprisingly^ the modification indices 

provided hy LISREL suggested that allowing the variances and covariances 

associated with these three latent constructs (SES, Black, Hisp) to differ 

across the two groups would improve the fit. In model M2 (Figure 1) these 6 

parameters were freed, that is were not held invariant across the two 

groups. CNotei In subsequent discussion we use the expression "freeing 

parameters** to mean estimating parameters separately for each group.] The 
2 

change in X (107) was substantial in relation to the change in df (6), 
indicating the superiority of model M2. It should be noted, however, that 
the changes in fit indicators (e.g., TLIs of .989 vs. .987) are very small. 

Insert Table 2 About Here 
In model n2f 160 parameter estimates were fixed to be invariant across 
the public and Catholic school data ~ all but the 13 latent mean 
differences (i.e., latent construct intercepts) and the six parameters freed 
in M2. An omnibus test of the invar iance of 133 of these parameters — all 
but the intercept terms for the 27 measured variables — was provided by 
model n3 in which al 1^133 parameters were freed. Despite the large sample 
sizei the change in X (149) was small in relation to the change in df (133) 
and. not statistically significant. The TLI which takes into account the 
number of estimated parameters is marginall/ higher for VQ (.989) than for 

14 
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M3 (.986). The overall goodness of fit of model M2 and this omnibus test of 
factorial invariance provide good support for Model M2. 

Model M4 provided a multivariate test of adjusted group differences on 
the 6 (adjusted) latent group means reflecting the senior year and post- 
secondary outcome variables. Model M4 differed from model M2 in that mean 
differences on these 6 latent constructs were fixed to be 0. The change in 
X (147) in relation to the change in df (6) was large and statistically 
significant. 

PgC3!!!§ter Estimates For the Selected Model 112^ 

On the basis of tests summarized in Table 2 and an inspection of the 
parameter estimates, model M2 was selected as the most appropriate model. 
Estimated factor loadings (Table 3) suggest that each of the latent 
constructs with multiple indicators is well defined. The correlated 
uniquenesses for matching measured variables assessed in the sophomore and 
senior years are substantial (Table 3). It is also interesting to note that 
factor loadings and uniquene.^ses associated with matching sophomore and 
senior variables are similar (Table 3). [Strict tests of the invariance of 
these parameters (model M5 in Table 3) failed, however, due primarily to 
factor loadings associated with the science and writing tests and the second 
indicator of educational aspirations.] Covariance terms relating the three 
background constructs — SES, Black, and Hisp — are all negative (Table 4). 
Residual covariances among the 4 sophomore outcome constructs and among the 
5 senior outcome constructs are all positive (Table 4). The background 
constructs are substantially related to subsequent outcome measures (Table 
4), though much of their effect on senior and post-secondary outcomes is 
mediated by sophomore outcomes. 

Insert Tables 3 and 4 About Here 

The most important parameters for present purposes are the 
public /Catholic dif-^erences in the latent construct means. Consistent with 
the design of the structural model, latent mean differences in: (a) the 
background constructs are unadjusted (i.e., adjusted and unadjusted means in 
Table 5 are the same), (b) the sophomore outcome constructs are adjusted for 
background constructs, (c) the senior outcome constructs are adjusted for 
background and sophomore constructs, and (d) the post-secondary construct 
are adjusted for background, sophomore, and senior constructs. Consistent 
with previous research with the MSB data, public/Catholic differences in 
backgrou id and sophomore outcomes are not interpretted as school-type 
•ffKtft, mhereas public /Catholic differences in senior and pott-secondary 
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outcomes that have been corrected -for background and sophomore constructb 
are interpretted as school-type effects. All adjusted and unadjusted group 
differences or. the latent means are presented in Table 5, but the emphasis 
in sub5ec;aent discussion is on the adjusted differences for senior and post- 
secondar> outcomes. 

Insert Table 5 About Here 

For .Tiodel M2, the selected model, publ ic 'Cathol ic differences in 
adjusted latent means are stotisticall / significant for all 5 senior outcome 
constntcta, bat not for the post-secondary outcome. In model M2, the 
variances and co^ariances associated with the three bacigrjund constructs 
were n^.t held to be invariant across groups. Inspection of the latent mean 
dif f erenc^'^j for model Ml that forced these coefficients to be invariant 
(Table 5), however, shows that these restrictions had no effect on any of the 
latent .nean differences ti.e., they are the =;ame for the two models up to the 
third pi::? beyonJ the decimal point tha!: is normally presented by LISREL) . 

MoJ'l M3 diJ not C3n5trdin any of the parameters a>{cept the intercepts 
of th:? .n- a->ur<?d /=iriatjles to be invariant tin order to make the model 
idantifi !) and Jn^ia^l Jif^er^jnces on sui*; a .noJel would generally be 
diffi 'i!t to int^rprj?t. The results in Table ^, however, indicate that the 
1 at.jft': .n:.^n differences in models Ml and M2 Are very similar to the 
rorr ?-;p jr. ji parameter estimates in modsl This similarity is because 
all th^ "^maining parameter estimates in the unconstrained mode! M3 are 
similar *^ those in models Ml and M2 that constrained all or most parameters 
to be invariant. These findings demonstrate that public/Catholic differences 
reported here are apparently robust with respect to restrictions placed on 
the in variance of parameter estimates in the two groups. 

Interpretations of the latent mean differences suggest that Catholic high 
school students have better mathematics and verbal achievement, have higher 
educational aspirations, are more likely to be in the academic track, and take 
more academically related courses in their senior year of high school than do 
public school students even after controlling for SES, race, and sophomore 
out«:ame vjiriables. Whereas public and Catholic high school students differ 
substantially on their Cunadjust^d) attendance of college during the first two 
years aft-sr high school, these differences are not significant after 
controlling for SES, race, sophomore and senior outcome variables. 
fiUSCO^tivg Mgdels QgiiaOSd Tes^ A^^i^i^n^ SubS&SQti vg ISf^gSi 

An important advantage of the SEM approach to testing latent Man 
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J'ff-r T ji :.s ;t:s f ! /..iMlit:/. Tha sel-vzt^i .r.o:!:?! be modified in a 
. -ri * f ' WA/-:> *:j ? .'it:3*:ar^1:i * .^.^ 1^3 that wl!! jften be 

L.11}i/. .:- i*:!.: t : ^ :*!cir .^/.p! icati .ort. T^*.i f ! .bi 1 ; t/ is demonstrated 

wI*:*. .-I'.jr jiti-ti' .nxf?'!-. g/jr^-j ••0 iiJJr'^ai: : jI: st ant 1 . 3l / impjrtaiit issues 
*hi (.reL^r.t if .csti^Ci*, :cn. 

EkLliLZCiilLikilik ilifs:LiLii5 £L LSlliSS £li£D^sD£gi "The nonsignificant 
! ^t^ij*. .nr3<;. I,^^.-- f^r thi' po^t-s^conddir/ construct (Table 5) should be 
l.Mte^^ t -t*:-f.I :v t'-.^u .!/, c-.sa this jie=i;i difference has been corrected for 
5h?''.iw*'- :.t:--r» . _fP. i'.^ ..ti .< i well v^s f-^r sophomore and background constructs. 
Ir. th- *: r .rtl .^l 3,;3, -f path analysis, it is the direct effect of the grouping 
._:ri iiblr . th p3st-5'?:a.i:Jary outcome construct. For the HSB data, it is 
3! 3: : i. ^f .l t} -3r.5ider the effect of the public/Catholic grouping 
✓ rir ijible that ii jic?diated through the senior outcome constructs after 
^uiitr filing fr;r hac^ ground and sophomore constructs. Using the language of 
^ .th 3nal,&&s this effect would be the sum of the direct and indirect 
effects of the publ ic/CAthol ic grouping variable. For the HSB data, 
puhl ivi/Catholic differences in background and sophomore outcomes are 
typi::all/ not considered to be school-type effects, and so it may not be 
meaningful to consider the effect of the public/Catholic grouping variable 
that are mediated through these constructs. 

There are several ways in which model n2 could be modified to obtain 
the effect of school-type on university attendance correcting for background 
variables and sophomore outcomes. For present purposes, we posited an 
alternative structural model in which the post-secondary latent construct 
was merely correlated with five senior latent constructs (see MB in Table 2 
and Figure 1). This involved fixing the five path coefficients (in <BE>) 
leading from the senior constructs to the post-secondary outcome to be zero 
and estimating the corresponding 5 residual covariances (in <PS> subject to 
the constraint that these 5 parameter estimates were still invariant across 
groups. It is important to emphasize that MS must necessarily provide the 
same fit as model 112 (so long ^s both models converge on a well-defined 
solution), but that adjusted mean difference in the post-secondary construct 
in model 8 is only adjusted for background and sophomore constructs. For 
model MB, the mean difference in the post -secondary construct is 
statistically significant (mean difference^ -.169, 8E3.047) and moderately 
large in comparison with the variance of the post-secondary construct (.7S7| 
Table 4). Based on the logic of the present application, we interpret this 
^.o mean that Catholic high school students attend college warm then public 
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high school students even after controlling for background and sophomore 
outcomes, but that this difference is largely mediated by public/Catholic 
differences in senior year outcomes. 

Interactions with initial student characteristics. As summarized 
earlier, an un'-esolved issue is »«hether public/Cathol ic differences vary 
according to SES, race, or initial ability level. The lack of resolution was 
due in part to the inability to appropriately control for measurement error. 
The previous comparison of models M2 and 113 provided a omnibus test of the 
invariance of 133 parameter estimates in public and Catholic high school 
samples. Because there was support for this invariance, the findings imply 
that the public/Catholic grouping variable does not interact significantly 
with these individual student characteristics. 

The comparison of models 112 and M3 was based on so many parameter 
estimates, however, that it is possible that a few statistically significant 
and substantively important differences were overlooked. For this reason, 
more specific tests of these interactions and an inspection of the parameter 
estimates are considered in two additional models. Following previous 
research, further models were tested to determine the differential effects 
of SES, race, and initial ability in the public and Catholic samples. In 
model n6 the 30 path coefficients (in <6E» leading from the three 
background constructs (SES, Black, and Hispanic) to the re.r.airins 10 Ir^rnt 
constructs were estimated independently for the two groups. Tn .Tiodal ^!7, 
these path coefficients and the additional 24 path ^cef icisnts Isadir.j fr::.:. 
the four sophomore constructs to the remaining ^ cons^.ruzt^ were also ^ 
estimated independently for the two groups. Tn sach ca^e, changes in X 
between model n2 and these additiortal mDdelz .^^s sma!! '2T ^r.d ZL 
respectively) in relation to tht? chang^a ir. :!f 'TO j^ni 54) and not 
statistically signff leant 'E:e7> Table 2). Fir t^.c-rmor a , "^LT ir.de;: that 
adjusts for the number pstii.'ic^teJ paratnet^^r uss iTc.r.ji:.jiT ! / poorer for 
these alternative models than for .node! M2. 

Inaer*: Table b About Hers 

The lack of siynif Inant di f f erenct?^. tet;^ea'n l*!odw?la T'?, Hi arid M7 
should, perb*?pEi, pr£'ClL.:U' ah, further '-l.,;:; deration cf tbcse interaction 
effects. Ne.^rM.-le.-.., ^.j: {.L.r^ose-:. c.T : ! ! . ^tr j^t: on, p .;T.ett'ri estiff.ates 
for the public Jtni Catholic ia.Tipl^^ that are most relevant to this issue are 
shown in Table Hnly jn^: ^abl io/Cathol ic difference was statistically 
significant at the f.ominal p ''.05 level (r.one were significant at p < .01, 
and non9 of those not presented was statistically significant at tither 
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^ " ' ' .^ri-^r ^ ^^'.r.t:..:, r^n.c^ll as well and 

• * • • ^ ' ^. V ' ^ ^ r , * ;,ever, including 

^ ' * ** *> -ij * * -i V. ;more achievement 
' • * ^ . , ^^ teing black (negatively) 

^ " , i ^-e public sample than in the Catholic 

* ' * the direction of these differences might be used to 
*: contention that initially disadvantaged students are better off 
'Catholic high schools, such a conclusion may be unjustified, 
"^f) * ::f ically, because of the design of the HSB study, public/Catholic 
differences in sophomore outcomes are not interpretted as school type 
effects. It is possible, perhaps even likely, that Iom-SES and minority 
students who elect (or were selected) to attend Catholic high schools 
differed from those who did not. Because differences in the paths leading 
from the background and sophomore achievement constructs to senior and post- 
secondary outcome constructs are consistently nonsignificant and apparently 
trivial in size, there appears to be no support for the contention that 
public/Catholic differences vary depending on SES, race, or initial ability 
levels for the HSB data. 

E[L8£SSS variables that mg^ijtg Syblic/Cathol di f f gcgncgs^ Harsh 
(1988), suggested that public/Catholic differences in senior year achievement 
and subsequent college attendance may be mediated largely by the more 
academic orientation of courses selected by Catholic high school students. 
Two variables that he considered were included here: academic track and 
number of credits in academic courses. In support of this suggestion he 
demonstrated that public /Catholic differences were larger on these variables 
than other senior and post -secondary outcomes and that controlling for these 
senior outcomes rendered as nonsignificant the public/Catholic differences in 
the remaining senior and post-secondary outcomes. 

In order to test this proposal, model MS was altered so that latent 
mean differences in senior achievements, senior educational aspirations, and 
college attendance were adjusted for senior academic track and number of 
academic credits in addition to background and sophomore constructs (see 
Model M9 in Table 2 and Figure 1). This was accomplished by positing track 
and credits to directly effect the remaining senior and post-secondary 
outcomes instead of merely heing correlated with them. Again, it should be 
noted that n9 must necessarily have the same fit as models H2 and MS, but 
differs in how mean differences in the latent constructs are adjusted. After 
adjusting for track and credits, mean differences were substantially sMller 
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and failed to re«ich statistically significance for senior math achievement 
(-.040), senior verbal achievement (-.056), senior educational aspirations 
(.no's) an-! -ollege attendanc«? (-.046). Furthermore, when latent mean 

lif f er^^nc^^s in ♦^h^^se remaining four outcome constructs were fixed to be zero 

2 

•inort?] fllO m TahlR 2), the change in X (5) was small in relation to the 
hanje in df (4) ^nd not statistically significant. These results support 
U.t? proposal th^t publ ic/Cathol ic differences emphasized here and in 
j-'r-^/iou-s ft^^'^arch may be mediated largely by sector differences in the 
^•,-.Jt?frii - jf* i^nt^tion of courseworJ . It is important to emph^^size that the 
lotji: nf thi4 model still indicates that differences in senior achievement, 
-»!«'i:Ational Aspirations and college attendance are legitimate school-type 
jf^o.-f^. In thi^ respect, the analyses suggest what appears to be an 
'.mt^ w^.^nt policy difference between public and Catholic high schools that 
Md/ ire. Hint for public/Catholic differences in other outcomes. 

Summary and I(ngl.i.catigns 
Analysis of rovariance is routinely used in the comparison of 
;-i jnequlvalen*. groups despite its many implicit assumptions that are 
typically ignored and often untestable. The more general multiple regression 
^.y^rO'Mzh to inaly^is of co/ariance provides important advantages, but still 
.-.uffer-:; important limitations that were discuss*?d in relation to previous 
j.*,ily^^?s of p'.'blir an*! Catholic high school students in the HSB study, 
rw^hotjtilogiciill/, the present application of th^ SEM approach to multi-group 

.iin^j ar* i 4or;3 )f latent mean differences offers important advantages over 
Iraditiona! approaches to multiple regression used previously. In 
particular, the present approach: 

1) test'i the implicit factor structures used to form variables that 
l:^ve multiple indicators and the invar iance of these factor structures 
dcross groups; 

2) provides tests of and more appropriate corrections for measurement 
error and correlated uniquenesses; 

3) tests for mean differences in latent constructs that have been 
appropriately corrected for measurement error; and 

4) provides omnibus and specific tests of whc^ther effects on the latent 
constructs attributable to grouping variables interact with other constructs. 

The present application involved a moderately simple structure used to 
compare latent means in just two groups. The approach, hoiievery can be 
easily extended to include a larger number of groups, factorial designs of 
multiple grouping variables, additional covariatos or outcomo Masurot, 
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fallible covariates and outcome measures that are parallel, tau-equivalent 
or congeneric, and provision for testing a Mide variety of alternative 
structures that are idiosyncratic to a particular application (Sorboii, 1982; 
Joreskog & Sorbom, 1981). It is also ir^portant to note that many of the 
advantages of the SEM approach also apply to comparisons of randomly assigned 
groups in the same way that ANCOVA is used in both experimental and 
nonexperimental studies. 

Despite the important advantages of the SEH approach to multi -group 
comparisons, there are also important limitations. First, there are 
practical limitations to the number of measured and latent variables and 
the number of groups that can be considered. These limitations are largely 
a function of the computer and software used in the analyses and further 
developments in the efficiency of the statistical procedures may resolve 
this problem. Second, the interpretation of latent .iiean differences becomes 
more problematic as the measurement and structural parameters become less 
invariant across groups. Host published examples, like the present 
application, have provided good support for the invar iance of factor 
loadings and path coefficients relating covariates and outcome measures. 
The invariance of these path coefficients corresponds to the homogeneity of 
regression assumption in ANCOVA. When this assumption is not met, it is 
still possible to interpret group differences, but the size and even the 
direction of group differences will depend on values of one or more 
covariates (see Cohen & Cohen, 1985; Judd & Kenny, 1981, for a discussion of 
this issue in the multiple regression approach to ANCOVA that generalizes to 
the SEM approach). As of yet, there are apparently no widely agreed upon 
minimum conditions about what parameters must be invariant in order to 
compare latent mean differences or how robust existing approaches are to 
minor violations of these conditions. 

A third limitation of the SEH approach to multiple*-group comparisons of 
latent mean structures is that groups must be inferred from discrete, error- 
free grouping variables. Hhereas this assumption is pluasible for a wide 
variety of grouping variables (e.g., sex, racmy randomly assigned 
experimental and control groups) many grouping variables are continuous 
(e.g. I age) and/or cannot be measured without error (SES). The application 
of the techniques described here requires continuous variables to be divided 
into discrete categories and measurement error to be ignored in amsigning 
subjects to these discrete groups. There may be special conditions in which 
these pragMtlc alternatives are acceptable, but in general they mre not. A 
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viable alternative may be to conduct analyses on a total group covariance 
•atrix in which grouping variables are represented as latent constructs. 
This approach provides for continuous, fallible grouping variables that are 
corrected for fteasurement error, but it imposes other important lioitations. 
First, many of the tests of invar iance that are so important in the multiple 
group comparisons are not easily performed and may not be testable. Second, 
in a related problem, nonlinear effects of latent constructs and 
interactions between latent constructs are not easily estimated with 
existing software. Kenny and Judd (1984) have described a procedure for 
estimating nonlinear and interactive effects of latent variables, but this 
procedure could not be implemented with LISREL (the authors used COSAN as 
described by HcDonald, 1978), required use of generalized loss function 
instead of the maximum likelihood loss function, and did not provide any 
standard errors with which to evaluate parameter estimates. They concluded 
by noting that their procedure was "merely a beginning to developing a 
general approach to such estimation" (Kenny & Judd, 1984, p. 209). 
Interestingly, however, it is easy to test for interactions between 
discrete, error-free grouping variables (e.g., public and Catholic high 
school students) and a continuous lateni construct based on fallible 
measures (e.g., SES) using the multiple-group approach as demonstrated in 
the present application. It would also be easy to test for interactions 
between two discrete, error-free grouping variables. 

In summary, the SEH approach to multiple group comparisons of latent 
means has important advantages over traditional approaches to ANCOVA. The 
approach can readily be generalized to a wide variety of applications, but 
there are also important limitations. A particularly important limitation is 
that groups must be inferred on the basis of discrete, error-free grouping 
variables. 
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FOOTNOTES 

1 ~ Of the 24 coefficients presented by Hoffer, at al. (1985, Table 2.4), 
only five exceeded twice the reported standard error of the difference and 
only one exceeded three times the reported standard error. Assuming a 
design effect of l.S, only one of the 24 differences is statistically 
significant at p < .05 and none is significant at p < .01. Also, the actual 
analysis presented by Hoeffer et al. included school -level means as »«ell as 
individual student values for race, SES and sophomore achievement, and so 
these analyses may not be comparable to those presented by Alexander and 
Pallas (1985) that Mere based on just individual student values. 
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Table 1 

Public and Catholic Htans and SDs For H«asur«d VariablM 

Measured Public School Catholic School Latent 

Variales Mean SD Mean SD Construct 

Background Variables 



1. 


(yl) 


SES-1 


-0.043 


0.994 


0.509 


0.932 


SES <et>l 


2. 


(y2) 




-0.044 


0.994 


0.547 


0.904 


SES <et>l 


3. 


(y3) 


Race — Black 


0.018 


1.021 


-0.226 


0.643 


Black <et>2 


4. 


(y4) 


Race — Hispanic 0.008 


1.009 


-0. 099 


0.874 


Hisp <et> 


Sophomore Outcomes (based on 1980 data) 






3 


5. 


(y5) 


Math-l 


-0.031 


1.004 


0.362 


0.871 


Math <et>4 


6. 


(y6) 


riath-2 


-0.022 


0.999 


0.256 


0.972 


Math <et> 


7. 


(y7) 


Science 


-.018 1.008 0. 


209 0.881 Hath <et>4 Verbal <et>5 


8. 


(y8) 


Read 


-0.028 


1.001 


0.329 


0.933 


Verbal <et>5 


9. 


(y9) 


Vocabulary 


-0.037 


0.998 


0.437 


0.914 


Verbal <et>5 


10. 


(ylO) 


Write 


-0.033 


1.003 


0.375 


0.880 


Hath <et> Verbal <et> 


11. 


(yll) 


EDASP-1 


-0.015 


1.005 


0.236 


0.883 


4 

EDASP <et>6 


12. 


(yl2) 


EDASP-2 


-0.039 


0.997 


. 0. 467 


0.906 


EDASP <et>6 


1'. 


(yl3) 


EDASP-3 


-0.030 


0.994 


0.354 


1.000 


EDASP <et>6 


14. 


(yl4) 


Track 


-0.049 


0.984 


0.584 


1.014 


Track <et> 


Senior Outcomes (based 


on 1982 data) 








15. 


(ylS) 


Math-l 


0.113 


1.091 


0.698 


0.940 


Math <et>8 


16. 


(yl6) 


Hath-2 


0.094 


1.043 


0.'W2 


1.074 


Math <et>8 


17. 


(yl7) 


Science 


0.149 1.030 0. 


459 0.88' Hath <et>8 Verbal <et>9 


18. 


(yl8) 


Read 


0.200 


1.068 


0.687 


0.972 


Verbal <et>9 


19. 


(yl9) 


Vocabulary 


0.328 


1.069 


0.930 


0.869 


Verbal <et>9 


20. 


(y20) 


Mrita 


0.261 


1.009 


0.744 


0.797 


Math <et> Verbal <et> 
8 

EDASP <et>10 


21. 


(y21) 


EDASP-1 


-0.039 


1.012 


0.287 


0.847 


22. 


(y22> 


EDASP-2 


0.010 


0.942 


0.S19 


0.876 


EDASP <et>10 


23. 


(y23) 


EOASP-3 


.142 


1.018 


0.630 


0.996 


EDASP <et>10 


24. 


(y24) 


TRACK 


0.020 


1.007 


0.765 


0.947 


Track <et>ll 


25. 


(y2S) 


Credits 


-0.068 


0.967 


0.836 


0.998 


Credits <st>12 


PMt-Sacondary Outcome 


Variables 


(based 


on 1984 data) 




26. 


(y26) 


P08TSEC-1 


-0.040 


0.996 


0.S14 


0.910 


P08TSEC <et>13 


27. 


(y27) 


POSTSEC-2 


-0.038 


0.994 


0.491 


0.949 


P08TSEC <et> 

13 



9 



|!|B^ See Appendix 1 for a descrii tion of the variables. Yl-yl4 and y29-y27 
were standardized so as to have Hean>0, SD«1 across the total saiiple. Each 
senior variable (ylS-y24) that Mas paired nith a sophOMsre variable (yS-yl4) 
MS standardized using the total saeple Man of the corresponding sophoMre 
variable. The latent constructs <et>^-<tt>^^ assoclateil tilth each eeasured 
varijbls mrm the ovals in Figure 1. 
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Table 2 

BoodnMS of Fit Indtxes for Altei native Models 





2 

y 


UT 


PMCiR 

nnoA 


Tl T 


DO A 


Ml 

m 


1 ASA 




rt^A 


• TO/ 


OQ1 






A9S 




• TOT 


. TOO 




1 1 OA 


A09 




OQA 
• TOO 


OQA 
. TO^ 


MA 


1 Aon 


ATI 




ORA 
• TDO 


OQI 
• TOl 


MS 


1S71 


AA7 


• UZCJ 


ORA 
• TOO 


oan 

. TOU 


MA 

no 




SOS 




0 

• T 


O— -> 
. T 


M7 

n / 


1 Ov/ 


S71 


• uzo 


0~ 
■ T 


0— 

. T 


a 

MS 


1343 


625 


.023 


.989 


.983 


a 

M9 


1343 


625 


.023 


.989 


.983 


NIO 


1343 


625 


.023 


.989 


.983 


MO 


76621 


784 


.406 


.000 


.000 



Model Descriptions (also see Figure 1) 

Ml All param'»ter estimates invariant except for latent mean differences. 

M2 Model Ml with Variances and Covariances of Backaround constructs (SES, 
Black, Hisp) not invariant across groups (Fig. 1). 

M3 No parameters invariant except measured variable intercepts. 

M4 Model M2 with adjusted mean differences on senior and post-secondary 
latent constructs fixed to be zero. 

MS Model M2 with all factor loadings and uniquenesses for matching sophomore 
and senior measured variables constrained to be equal over time. 

M6 Model M2 with the 30 path coefficients leadina from SES, Black, and Hisp 
to each of the remaining 10 constructs being treed. 

M7 Model M6 after freeing the 24 path coefficients leading from the 4 
sophomore outcome constructs to the 6 senior and POSTSEC constructs. 

a 

M8 Model i2 with Post -secondary latent mean adjusted for only background and 
sophomore outcome constructs (Fig. 1). 

n? Model M8 with POSTSEC, senior Math, Verbal, and EDASP latent means 
adjusted for background variables, sophomore outcome variables, and 
senior Track and Credits (Fig. 1). 

MIO Model M8 with adjusted POSTSEC, senior Math, Verbal, and EDASP latent 
mean differences fixed to be zero. 

MO Null model in which the fitted matrices were constrained to be diagonal 
for both groups (used in computing the TLX and BBI indices). 



(jgj^B^ RMSR«Root Mean Square ResTdiial. TLI>Tucker-Lewis Index. BBI>Benter- 

Bonett Index. (See Marsh, Ball a & McDonald, 1988, for further discussion of 

these indices), 
a 

Models M8 and M9 are necessarily equivalent to M2 in their ability to fit 
the data. They differ in the posited ordering of the latent constructs so 
that the latent means are adjusted for different constructs in determining 
public/Catholic differences. 
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Table 3 

Parameter Estimates For Model (H2) For Measured Variables 



b 

a Correlated 
Measured Variable Factor Loadings Uniqueness Uniqueness Intercepts 



1. SES-1 


1 




0.211 




.516 


2. SES-2 


1.047 




0. 135 




.542 


3. Race — Black 


1 




0 




-.226 


4. Race — Hispanic 


1 




0 




-.099 


Sophomore Out cones 


(based 


on 1980 


data) 






5. Math-1 


1 




0. 130 




.354 


6. Math-2 


0.777 




0.474 


0.091 


.275 


a 

7. Science 


0.246 


0.702 


0.374 


0.146 


.339 


8. Read 


1 




0.294 


0.067 


.358 


9. Vocabulary 


1.003 




0.284 


0. 103 


.359 


a 

10. Write 


0.199 


0.726 


0.409 


0.187 


.330 


11. Educ Aspir-1 


1 




0.666 


0.154 


.290 


12. Educ Aspir-2 


1.578 




0.174 


0.010 


.451 


13. Educ Aspir-3 


1.326 




0.416 


0.085 


.378 


14. AcdTrack 


1 




0 




.584 


Senior Outcomes (based on 


1982 data) 






15. Math-1 


1 




0. 125 




.682 


16. Math-2 


0.786 




0.444 




.537 


a 

17. Science 


0.201 


0.683 


0.379 




.604 


18. Read 


1 




0.286 




.712 


19. Vocabulary 


1.002 




0.274 




.850 


20. Write* 


0.159 


0.672 


0.418 




.701 


21. Educ Aspir-1 


1 




0.618 




.325 


22. Educ Aspir-2 


1.353 




0.187 




.507 


23. Educ Aspir-3 


1.369 




0.323 




.643 


24. AcdTrack 


1 




0 




.765 


25. AcadCredit 


1 




0 




.836 


Post -Secondary Outcome Variables 


(based on 1984 


data) 




26. Post-Sec-1 


1 




0. 196 




.510 


27. Post-Sec-2 


0.973 




0.239 




.496 



Note. The numbers associated with each measured variable correspond to those 
for the measured variables in Table 1 (also see Appendix). Parameter 

estimates of 1 and 0 were fixed (i.e., not estimated). All estimated 

parameter values are statistically significant (p < .09). 
a 

Just these measured variables are associated two latent construts. The 
loading associated with the math construct is prese itmd first, followed by 
the loading associated with the verbal construct. ThMe eight m priori 
^correlated uniquenesses were posited between the same measured variables 

ERXC»i'^i»t*^»<* on different occasions. 
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Table 4 

Parameter Estimates Relating Latent Constructs In Model (112) i Construct Variances and 
Covariances (above main diagonal) and Path Coefficients (below main diagonal 



Latent 
Construct 





1 


2 3 4 


5 


6 


7 


8 


9 


10 


11 


12 


13 




a 


b b 


















1. SES 


(.777) 


-.215 -.177 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


2. Black 


0 


a b 
(i. 042) -.145 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


3. Hisp 


0 


a 

0 (1.018) 0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


4. Math 


.354 


-.204 -.179 (.650) 


.436 


.168 


.260 


0 


0 


0 


0 


0 


0 


5. Verbal 


.339 


-.211 -.192 0 


(.487) 


.141 


.232 


0 


0 


0 


0 


0 


0 


o» Educ Asp 


.339 


c 

.086 .013 0 


0 


(.242) 


. 172 


0 


0 


0 


0 


0 


0 


/• Track 


.Zto 


c 

y\00 Ail /_ yv 

.022 -.046 0 


yv 

0 


0 


(.901) 


0 


0 


0 


0 


0 


0 


8. Math 


.032 


-.039 -.030 .887 


.045 


.182 


c 

.017 


(.145) .078 


.021 


.049 


.070 


0 




c 


c 






c 














9» Verbal 


.012 


-.043 -.026 .036 


.935 


.081 


.011 


0 


(.096) 


.010 


.018 


.028 


0 


10. Educ Asp 


.081 


c 

.050 .014 .025 


.113 


.665 


.029 


0 


0 


(.130) 


.071 


0 


0 


11. Track 


.047 


.052 .028 .071 


.206 


.424 


.303 


0 


0 


0 (.613) 


.135 


0 






c c 




















12. AcadCred 


.013 


.021 .026 .216 


.149 


.467 


.163 


0 


0 


0 


0 


(.587) 


0 








c 






c 


c 










13. Post-Sec 


.079 


-.009 -.007 -,022 - 


.125 - 


.053^ 


-.005 


.133 


.132 


.763 


.052 


.088 


(.345) 


Latent 
























Construct 
























Variances 


.777 


1.042 1.018 .786 


.621 


.316 


.960 


.950 


.746 


.367 


.988 


.924 


.757 



(!9iiA Sec Figure 1 and Table 3 for the relations between each latent construct and the 



corresponding measured variables. All parameters values of 0 were fixed (i.e.| not 
estimated). Parameter estimates in parentheses are variance (for constructs 1*3) or 
residual variance (for constructs 4-13) estimates for each latent construct (from PSI). 
Parameter estimates above the main diagonal are covariance or residual covariances (from 
PSI). Parameter estimates below the main diagonal are path coefficients (from <BE» 
leading from column variable to the row variable. Variances are variances of the latent 
constructs which will necessarily be larger than the residual variance estimates in the 

main diagonal for <et> -<et> . All parameter estimates were constrained to be the same 

1 13 

for both groups except for those noted in footnotes a and b to this table, 
a 

Construct variance estimates are based on the Public data. The corresponding estimates 
for the public school group are .642,^ ^^412 .761. Construct covariance estimates are 
based on the Public data. The corresponding estimates for the Catholic (in parentheses) 
and public school groups are -.219 (-.046), -.177 (-.080), -.149 (-.038). ^ These 
parameter estimates are not significantly different from zero at 
p < .05. 
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Table 5 

Catholic /Public Differences on Latent Constructs (positive values indicate 
Public means > Catholic means) for selected models 



Model Ml Model M2 Model M3 



Latent Adj 
Constructs Mean SE 


Unadj 
Mean 


Adj 
Mean 


SE 


Unadj Adj 
Mean Mean 


SE 


Unadj 
Mean 


Background Constructs 
















1. SES -.560 .056 


-.560 


-.560 


.052 


-.560 


-.571 


.052 


-.571 


2. Black .244 .060 


.244 


.244 


.041 


.244 


.247 


.041 


.247 


3. Hisp .106 .060 


.106 


a 

.106 


.053 


.106 


.112 


.053 


.112 


Sophomore Outcome Constructs 














4. Math -.118 .054 


-.385 


-.118 


.054 


-.385 


-.139 


.051 


-.418 


5. Verbal -.127 .047 


-.389 


-.127 


.047 


-.389 


-.140 


.047 


-.411 


6. Educ Asp -.142 .034 


-.310 


-.142 


.034 


-.310 


-.147 


.032 


-.320 


7. Track -.468 .058 


-.633 


-.468 


.058 


-.632 


-.478 


.060 


-.646 


Senior Outcome Constructs 
















8. Hath -.112 .035 


-.568 


-.112 


.035 


-.568 


-.119 


.034 


-.609 


9. Verbal -.085 .029 


-.515 


-.085 


.029 


-.515 


-.086 


.028 


-.539 


10. Educ Asp -.057 .028 


-.367 


-.057 


.028 


-.367 


-.058 


.027 


-.081 


11. Track -.304 .049 


-.745 


-.304 


.049 


-.745 


-.304 


.050 


-.763 


12. AcadCred -.516 .048 


-.904 


-.516 


.048 


-.904 


-.523 


.051 


-.928 


Post -Secondary Outcome Constructs 












13. Post-Sec -.037*. 044 


-.550 


-.037 


.044 


-.550 


-.036 


.045 


-.571 



ijQ&SjL shown in Figure 1 (model M2) Sophomore Outcomes are adjusted for 

Background variables, Senior Outcomes are adjusted for background variables 

and sophomore outcomes, and the Post -secondary outcome is adjusted for 

background variables, sophomore and senior outcomes. The size of mean 

differences may be evaluated in relation to standard errors (SE) or the 

variances of the latent constructs (see Table 4). 
a 

This latent POSTSEC mean difference is adjusted for all background 
constructs and for all sophomore and senior outcome constructs. In an 
alternative formulation (Model MS) in which POSTSEC was corrected for only 
background and sophomore constructs, the latent mean difference was -.169 with 
a standard error of .047. This suggests that there is a significant 
public/Catholic difference in POSTSEC beyond what can be explained in terms of 
background and sophomore outcomes, but that this effect is largely mediated 
through senior outcomes. 
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Table 6 

Tests of Interaction Effects: Path Coefficients Leading From SES, Black, Hisp, 
and Sophomore Math and Verbal Scores (and standard errors) estimated 



independently for Catholic (Cath) and public (pub) high school students. 



Latent 
Construct 
























SES 




Bl ack 




Hisp 




Soph Math 


Soph Verb 




Cath 


Pub 


Cath 


Pub 


Cath 


Pub 


Cath 


Pub 


Cath 


Pub 


Sophomore Outcomes 




















4. Math 
SE 


a 

.191 
.067 


.365 
.019 


-.162 - 
.079 


-.204 
.015 


-. 141 
.058 


-. 180 
.015 




V 


Ct 

V 


U 


5. Verb 
SE 


.262 
.059 


.343 
.017 


-.133 - 
.070 


-.213 
.013 


-. 102 
.052 


-.197 
.013 




Cl 

V 


Ct 

V 


f\ 

u 


A. EDASP 
SE 


.294 
.043 


.342 
.014 


.086 
.050 


.086 
.010 


.034 
.037 


.012 
.009 


0 


0 


Q 

V 


n 


7. Track 
SE 


.332 
.073 


.293 
.020 


.064 
.087 


.020 
.012 


.012 
.064 


.050 
.016 


0 


0 


0 


0 


Senior Outcomes 




















8. Hath 
SE 


.053 
.052 


.030 
.015 


-.045 - 
.055 


-.039 
.011 


-.001 
.040 


-.032 
.010 


941 
.083 


883 
.034 


.097 


m Vf 1 

.035 


9. Verbal 
SE 


.009 
.042 


.012 
.012 


-.019 - 
.044 


-.043 
.009 


-.010 
.032 


-.023 
.009 


.035 
.067 


.035 
.024 


.863 
.079 


.940 
.030 


10. Educ Asp 
SE 


.092 
.040 


.080 
.012 


.059 
.042 


.050 
.009 


.022 
.031 


.013 
.008 


.066 
.065 


.021 
.020 


.082 
.077 


.116 
.023 


11. Track 
SE 


.130 
.071 


.040 
.020 


.027 
.074 


.053 
.015 


.049 
.054 


.028 
.014 


.095 
.115 


.068 
.035 


.106 
.135 


.215 
.041 


12. Credit 
SE 


-.028 
.070 


.016 
.020 


.021 
.073 


.021 
.015 


.029 
.054 


.020 
.014 


.206 
.113 


.216 
.035 


.195 
.133 


.147 
.040 


Post-secondary Outcomes 


















13. Post-Sec 
SE 


-.028 
.068 


.082 
.018 


-.080 - 
.066 


.005 
.014 


-.070 
.048 


-.002 
.013 


-.023 - 
.134 


-.023 
.088 


-.144 
.154 


-.123 
.112 



In ^h^s flM3del M7, path coefficients leading from background constructs 

and from sophomore outcome constructs were not constrained to be aqual in the 

two groups (see Table 3). Selected path coefficients for each sample and 

their corresponding standard errors are presented. 

Differences between the public and Catholic path coefficients are 

statistically significant (p < .05). For purposes of these analyses, SEdiff 

2 2 172 

was defined as [(SE ) + (SE ) 3 (see Cohen and Cohen, 1985, p. 

Cath pub » » K 

111, equation 3.6.11). 
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Appendix 1 

Definition of Variables Considered 



Social -Economic Status 



1. SES'1780. [BYSES] 1980 Composite socioeconomic status based on father's 
orxupation, father's education, mother's education, family income, and 
material possessions in the home (higher values reflect higher SES). 

2. SES'1982. [FYSE53 1982 Composite socioeconomic status based on father's 
occupation, father's education, mother's education, family income, and 
ifi'^tt^rial possessions in the home (higher values reflect higher SES). 

/Ethnicity 



3. Race-Blacl. CRace23 Ethnicity is Black. (l=yes, 0=nG) 

4. Ra. e- -Hispanic, [RaceZl Ethnicity is Mexican, Cuban, Puerto Rican, or 
a'lic^r Hispanic, (l-yes, 0=no) 

AfJiit?/einerit Outcome S.:ores (sophomore and senior /ears) 



Z 15. n«th achievem.>nt. CYBMTHIFS, FYMTHIFSI formula score for part 1 of 
tt'ic^ Hidtn Lesta for sophomore aind senior years. 

L % lo, Math acr.ievement. [YBriTH2FS, FYMTH2FS3 formula score for part 2 of 
ttie trici'i-. ^t?5t5 far sophomore and senior years. 

7 %. 17. ReaJing achievement. CYBREADFS, FYREADFS] reading test formula score 

fur' sophoinore and senior years. 

3 ^ 13. Vocabulary achievement. CYBVOCBFS, FYV0CBFS3 vocabulary test formula 

scor-:? for sophomore and senior years. 

9 • 19. Science achievement. CYBSCIMFS, FYSCIhFS] science test formula score 

for sophomore and senior years. 

10 S( 20. Writing achievement. CYBWRITFS, FYWRITFS] writing test formula score 

Tcir sophomor e and senior' yedr'j. 

Cvlucationiil Aspirations (sopuumore and senior years). 



11. ?/ 21. EDASP-1 r:BB061G, FY76G] Item asking whether disappointed if do not 
gradiiate fr om college (higher zinr^^ reflect higher educational 

a^pi r'at i Oi (S) . 

12. ^ 22. EDASP-2 CBB065, FY30] Item asking expected level of schooling 
(higher scores reflect higher educational aspirations). 

13. 23. EDASP-3 rBB067, FY32] Item asking lowest level of education would 
be satisfied with (higher scares reflect higher educational aspirations). 

ACddemic Track (sophomore and senior years) 



14. 24. Track. CBB002; FY23 In 1980 and 1982 participated in academic 

tr ack (l=/es, 0=na) 

Auddemic Courses (senior year) 



25. AcadCrJ. [NEWBASEl In 1932 number of credits in six academic areas. 



Post-Secofidary Outcome Variables 



26. Post Sec. CPSE30C82, PSESFEe3] Sum of variables indicatina student was 
not a student (0), was a part-time student (1), or was a full-time student 
(2) at some form of post-secondary institution at each of twc points in 
time during the firsl year after normal high school graduaticn. 

27. Po&t-Sec. CPSES0C83, PSESFE84] Sum of variables indicating student was 
not a student (0), was a part-time student <1), or nas a full-time^ student 
(2) at some form of post-secondary institution at emch of two points in 
time during the second year after normal high school graduation. 
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Not*. The nualMr astociatMl with MUEh v«r labia corrMpondt to tlw nuabars in 
tlw boxM that roprMant Mamrad variablaa in Figura 1. Valuaa in brackata 
r^m- to variablaa naaaa uaad on tha H8t data f ila. Hoat outcoaa varlablaa 
«ar tha aophoaora and aanior yaara aara pairad and daf inad Mith parallal 
y^ariabloa. 
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Appendix 2. The LISREL HultigrcNip Approach to Testing Group Differences in 
the Means of Latent Constructs. 

The usual LISREL single group covariance analysis fits a saeple 
covariance matrix for variables x and ^ with a theoretical matrix based on: 

Insert Equations 1-3 
The four parameter matrices «LX>, <LY>, <TE>, and <TD» are free to be 
estimated as factor loadings and uniquenesses, Mhereas the remaining four 
parameter matrices «BE>, <6A>, <PH>, <PS» are free to be estimated as 
latent partial regressions, latent variances and covariances, or latent 
residual variances and covariances. This model can be succinctly represented 
by the fol lowing path diagram (for which we gratefully acknowledge Jack He 
Ardle's influence)* 

Insert Figure 2 

This usual LISREL approach ooes not incorporate regression intercept 
terms. Sorbom (1982) describes a technique for incorporating latent 
intercepts into a multigroup LISREL analysis, thus allowing for tests of 
latent intercepts which under appropriate circumstances can be interpretted 
as mean differences in the latent constructs. This approach can be 
illustrated with the following path diagram and definitions. 

Insert Figure 3 

Insert Equations 4-9 
In this model, <al> and <mu> are latent and manifest regression 
intercepts. The truly estimatable parameter matrices with substantive 
interpretations are <mu>, <LY>, <TE>, <al>, <BE>, <PS>. These are enrbedded in 
the usual eight LISREL parameter matrices. In the present application (with 27 
measured y-variables, 13 latent constructs, two groups and one f ixed-X x- 
variables) these parameter matrices are: 

a (27 X 13^1) matrix (Equation 103 
a (27 X 27) matrix (Equation 111 
a (1 X 1) matrix (Equation 12] 

a (1 X 1) matrix (Equation 133 

a (iZ^i X 13^1) matrix (Equation 143 
a (13-M X 1) matrix (Equation 133 
a (1 X 1) matrix (Equation 163 

a liZ^i X 13^1) matrix (Equation 173 
In this formulation, the only role of x ; 1 is to allow the latent 
intercept terms (via regression of <et> on <xi> ; x « 1) and to allow 
manifest intercept terms (via regression of y on <et> ■ <xi> ■ x ■ 1). 

Such a structure is modelled in each of the groups. Supressing the <s 
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and using the superscript g =1, 2, ... to indicate the groups we have 

[Equation 181 

and under appropriate conditions of factorial invariance 

[Equation 191 

An indeter mi nancy remains, as the data expectations are unaltered if replace 

[Equation 201 

and 

[Equation 211 

This can be removed by fixing each component of <al> in one group or the other 
to be zero. Each column of <LY> should have a (scaling) 1 and <BE> reflects a 
latent regression that is identified. Under these conditions, <al > reflects 
the latent variable mean differences. For example, suppose that in our 
application we have: 

[Equation 22] 

and 

[Equation 231 

Then 

[Equation 243 

So, subjects mai.ched on <et> in the two groups will still differ on average 

2 (1) 72) 

in their <ET> scores by <al> - <al> . That is, this estimated 

3 3 3 

difference reflects the mean <ET> group differences, adjusting for <ET> . If 

3 2 
<BE> is not invariant across groups, however, then subjects with the same 

<ET> in both groups will have 
2 

[Equation 251 

so that the difference in <ET> is a function of the level of <ET> • This 

3 2 

represents a group by ^^^^ 
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FIGURE CAPTIONS 

Figure 1. Reduced path diagrams illustrating selected parameters from the 

structural portions of iiodels M2, M8, and M9. All constructs are assumed to 

causally influence all constructs to their right as indicated by single-headed 

arrows, although only lag-1 arrows are actually presented. As presented in 

Table 1 <et> -<et> are background constructs, <et>^-<et>^ are sophomore 

constructs, <et> -<et> are senior constructs, and ^et> is the post- 

8 12 13 ^ 

secondary construct. The triangle represents the "constant" variable used by 

LISREL to estimate latent mean differences. 



Figure 2 (Appendix 2). A condensed path-analytic representation of the general 
LISREL model. Single-headed arrows represent regressions and double-headed 
arrows represent covariances (or variances when self-ref erent) . 

Figure 3 (Appendix 2). A path-analytic representation of the general LISREL 
model that has been expanded to include regression intercept terms. 
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